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Abstract 



A computer-assisted instructional package designed to teach both specific 
series-solving skills and general problem- solving skills was run in a 
school environment for one year. Students had access to the program dur- 
!ng their free time. This paper analyzes the progress made by one student 
Jnboth series solving and general problem solving during his four hours of 
work on the program. 
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THK SERIES F^UOGRAM; ONE STUDENT'S BEHAVIOR 



Richard A. Roman and Joan 1. Heller 



Learning Research and Development Center 
University of PittsburiLjh 



Several computer programs for use by elementary school students 
havi- beon designed by the Computer- Assisted Instruction in Problem- 
Solviny Project at the Learning Research and Development Center. One 
of these» the Series program, is designed to teach specific series- 
solving skills and yeneral problem- solving skills. To assess the pro- 
gram's effectiveness, two studies have been undertaken. In the first, a 
laboratory controlled study, the learning and transfer of series-solving 
skills were measured (Heller, Note 1). This paper reports the second, 
a study of one student's entire history on the program, including both his 
serio« loarninji and his general problem-solving learning. 

The introduction describes the program as the student saw it, the 
way in which the series were chosen, and the context in which the stu- 
dent worked. In the next section^ the student's work and learning with 
respect to f - ries-solving skills is described. The final section describes 
the same work, but focuses on general problem-solving skills. 

■ ■ . ♦ 
How the Program Works 

In the Series program, specific series-solving skills are learned 
through the selection and sequencing of the Series puzzles themselves. 
General problem-solving skills are learned through the environment 



croatt.d lor th.. slu.lcnts whiU' tlu-y working cu. lli. p.-o^ranu \n ll.is 
,.nvi,on.,u.n.. HtmlcnlH nr. plnccc. in c:on,pUMo .ontrol of Hcvcral .nsp.cts 
of .h.tr ..xporlonc. .Sluden.s seU-ct ,l,e l.-vcl of .UfflcuUy for each .erioH 
SCOT, thoy control tho nmoun, of .inu- on ..ach series by imlicallng when 
,h.y wan. to chan«o to n now sories; they receive additional Inforn.ation 
(U-rms of the aeries) only upon request. After changinB to a new »eHes. 
...dents receive reedback on their previous perfov.nance. Thus, student, 
typically work through a cycle including selectinK a level of difficulty Cor 
the next series, working on the new series for as long as desired, getting 
feedback on their performance, and selecting a hew series. H.is cycle 
repeats until the students stop for the day, it resumes when they return to 
the computer terminal for a subsequent session. 

Now. consider what happens during work on each series. Once a 
series is selected, displayed, and work commences, the global goal for 
the student is to solve the series by inferring the rule of formation and 
generating the next terms of the series. Episodes of work involve the , 
more immediate goal of getting the next term displayed. A new episode 
of behavior begins with each new term. For example, when the series 
,-2 5 8. 1 1. N. ..." is displayed, the student's immediate goal is to 
get the next term (17) by srme sequence of actions in the available reper- 
toire The program allows three actions: Change to a new series, aban- 
doning the task., ask for the next term, causing the computer to display it; 
or guess the next term, receiving feedback on the guess. The student may 
attempt many guesses, but may change only once per puzzle and ask for 
the next term only once per term. Part of the global problem for the stu- 
dent is to determine, when the series is understood or when the series is 
too difficult: these are appropriate times to change to a new series. 

The displays constructed by the program convey aH'of the informa- 
tion given above in more concrete form to the students. One typical cycle 
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of u«e In llliint rntcd In Figure I. 'Hm Initial diHplay for a cycle Ih given 
In FiMVU'n I. rrnrnt' I. Notice that feedback for the previous cycle's glo- 
bal purfornianrc is ^ivon (YOU JUST PASSfc^l) LKVEL 13) and that the 
student may select from any of (ho ^yO available IuvuIb. When the student 
selects a level (17 in this ease), ono of 40 series whose difficulty is near 
that level is selected at random as the next problem. Hie initial display 
for a series is illustrated in Frame 2 of Figure 1. Notice that five terms 
are Kiven and that the student's options are listed. In this case, the stu- 
dent enters ••r^ " n plausible, but incorrect, guess. 'Hie feedback is shown 
in Frame 3 of Figure 1. Notice that the student again has the same three 
options and is still working; on the same term. The student types "NEXT," 
asking the computer to supply th« next term. Because the student previ-- 
ously made an error on the term, the incorrect i^uess is preserved in the 
display so comparison is possible. Frame 4 of Figure 1 illustrates the 
addition of a new term by the use of /'NEXT. " Tlie next two guesses were 
wronii ("B" and ''P'M. but the lliird guess was correci. Frame o of Fig- 
ure 1 illustrates feedback for a correct guess after two wrong guesses. 
Notice the reinforcing comment. "GREAT!". The display is accompanied 
by 'lie sound ^yf a bell for correct guesses. Frame 6 illustrates the dis- 
play when a correci guess follows "NEXT" or another correct guess. The 
previous series is erased from the screen and all the k,town terms are 
displayed at the top of the screen, Af with alJ correct jiuesses, the rein- 
forcing comment "GREAT?" is displayed and accompanied by the sound of 
the bell. 

How Ser i es A t <r i'onnod 

TIic Series program can display any of 400 general problems. Most 
of the 400 general problems are completed when the problem is selected by 
randomly choosing a starting point and/or an increment value. For exam- 
ple, if the general problem is to increment each term by 3, the specification 
might be completed by selecting a starting number between 1 and 20. Thus, 

3 



7 



UVELS GO FROM \ TO W 

YOU JUST PASSrt) LEVbl 13 

VVHAT LEVEL DO YOU WANT NOW ? 



Initial tJtsplJV tor cycle. 



'^''^^ i\ 0, u. 

P IS INCOMRECT 

0. B. P. 0. B. 0. 

TYPl^ -NIXT" OH -CHANCUV OM YOUM OUUB 
B 

Ffatne ^ 

Display to« "NEXT" ottiH tncof t»ct ouoss. 



0. B. P. 0. B, 

TYPt -Nex T- 0« "CHANCr:" OR YOUR C'JCSS, 
• •• P 



0. B. P. 0. B. 0. 
B IS INCORRECT 
P IS INCORRECT 
GREAT! 

0, B. P. 0. B. 0. a 

TYPE -NbXT" OR ''CMANGE" OR VOUR GUESS. 
... B 



Frame 2 
Initial display tor series. 



Display for correct guess 
alter two wrong guesses, 



0. B. P, 0. B. 
P IS INCORRECT 

TYPE -NEXT- OR -CHANGE" O^ YOUR GUESS. 
... NEXT 



Frame 3 
Feetlback for incorrect .J'less. 

Figure 1. A sequence 



GREAT! 

0. B. P. 0. B. 0. 0. B. 

TYPE "NEXT- OR "CHANGE- OR YOUR GUESS. 
. . . CHANGE 



Frame 6 
Display for correct guess 
after "NEXT" or correct guess. 



of displayb from the Series program. 
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■lIuMo hu.Hh.c<lH of (l,ouH,m.U of unlciuo H.-rU-H that cnn b. dlnplnyml 
by II... proHran,. Al.houKh Ihal numbnr U In,-„,!. I, t.«pr««antB only a 
«nmll fracdon of all im,i«l„«blo p.m.r.uMl H.quoncoH of l.tlcu-H nnd num- 

bcM-H. In •!>!« H'^cllon. .1,.. prlncipIoH lor «..l.ctln« probIon,H nnd for 
aniii).nlii>> dlffltniliy are duHcrlbiul. 

ilnjli'-ilLLli:". c;..rtain h.;mhl.k nr.. basic, ami It is as»um«d that all 
>.MM-. of th.. proKi-an, can .-xCnd tla-n, without difficulty. Uese Includo 
•IH- alphab...,. counting m,n,b.,,r« up to m. and any r.,p.,atln« pnttorn 
o. ono to four tortus. Th. alphabet s.ricH can begin at any of 26 letters 
and .ontlnm-H in a cych- with "A'' following 'V,. - The alphabet scries is 
.alU.d -AU'llA." rvn a ..,u.cif,c.sc.rlc.H. such an "R. S. T U V 
the. nanu.. ,s "ALPHA starting at 'IV. l^o of counting lun^Jor. \1 

called -CCl-NT... The sp-ofi. sorlos ^'27. ZH, ao. 3^,. ..... u na,.od 

"COUNT .starting a. " Any ropcating pattern is called a "REPEAT- 

«i.rl..s. The n,i.T,e for tho specific .series ' R. M, R. M. R. . . . is 

■■REPlCATof 'R. and 'M'... The HasR- series ALPHA. COUNT, and RE- 
PEAT wore assigned difficulty levels between 1 and 5. More complex 
s.^ries are built from the Basic s.-ries. 

rt is convenient to treat tu-o other series as Basic. These are the 
backward, alphabet. "BALPHA. - and the backwards counting numbers, 
"fiCOirNT. These series are not .vco,ni.ed immediately by all students 
and were assigned diffic'ully levels betw.-en 5 and 10. 

Any series can be used as a subserios in nnorc con.plex serie,. TT.e 
pro.ran, uses Hn-ce n,othods to combine simpler series into more complex 
dories: the intersperse method, the concatenate method, and the skip 
muthod, 

lat£r. ,per.o scrionv r-n'o make a new series by the intersperse method 
two or n.or.'subseries are combined by takint; terms alternately from each 
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M, . . . " \" 111 :iH<'i'" 



U. make llu. n.'W ^.-'-li-s. Ihu. "H. ... - • • ^^^^.^^^ 
Hpcrtie HtTlo* ot im M i ,(,.p.-inlM on tlx' 

HUrllnK at "^7. Hi. .Uincuuy .luflculiy nf tlu, Hub^.H-H. 

...... ..-.woe. ou. ...... or a.. . . 

, «„l>H..rU-s lnv<i\v...l in th.- p«tto.n. Hu 

" u.« ...Hv.-. 

pUi.u.J boHt by c,..u.pU.«. ^^^^ „,,ieH 

,anu. character, h.nvo lowor conUa^t ha . ^_ ^ ^_ 

wUhdUterentcharac.orH. ConMMr. ^-.w.n .lu- H«n.. charact.,rH 

. . ... wUh"B. M. S. " wWoH -^npuratcdln 

i„,achHub»erlea. contrast iBhiBhcrUlh ^ . wlth"U. 87. 

'7' w^on three sub.erles are combine, by 

„. H8. H. HO. O*. • • • Hon all tbree come from the 

,,„.,.per«.. methoa contrast ^ J ^^^^ , of! 

«... character «et. Otherwise. ^^-^ ^ ^_ 3. V. • • • " 

eon.tituent HubserieH. Compare . . ^-^^^-^ ^^^^^^ 

witb"A. 7. n. H. a. m. C, 9. ' . ' ' „f a slash acrosB 

anguished from the nun,ber.ero nth>»papc. 

^. ripiier* O; numbi-r: 01.) 

.He CUftculty because hi,b contrast maUesU 
: contrast is related to the d.ff^cu y 

...r to find the period with which ~ ^I^^ ^„ 
Simon (.973) have noted the relevance of thtsd^n 



. ..e concatenate method for combining Simpler 
CoriS^^SIl^i^^^- ,,,uues that terms from two or more 

««ries to make more complex series ^^^^ ^^^^ ^^^.^^ 

«ui,series be written next to each other. J 

,.ore difficult are analo.ou. -o those .n the .nte^ ^P^^^^^^^^^^^ ^^^^^^ 
p,e. the series ..6M. ,„„ BA1.PHA starting 

two contrasting subserves. COUN unnecessary to find 

at . .M.. ..He form Of the concatenate ser.^^^^^^^^^^^^ 

,He period; each term contains a term from 



f*«*ni«H "u. | . . , - ,i Skip Nrrli'H on ihv 

<: <)l N I MTlvM Miartlru- al a* rcrMlri^ (ti tlu^ paltorn KKI'KAT of " 

^Hialo..y .0 "D. v.. .1. M. P " -Skip s.ri.M Ih,. A MM lA H.riuH 

Martinu "(V act-ordin;. to ihr p.,ttiMM) UKlMCAT of 'M, " ,nni,,,H ^on- 
<'ra1iiy of (hiH naming cK-ar. Tho diCfVviUv of Skip ...M'lrs doprmU on iho 
Mihsorit.s uso.l ami ilu- cumplrxity of ilu. patliu'n. r^rncrally. a ^imlInr 
paitrrn will luMnort. di.fUMilt whm it up.M'att^s en ^ rlos riorlvutl from 
AI.IMIA than t>n .s.Tit'H rK-rlvi'd from COUN r. • 

I' inally. tlu' c umbuiinw uirthud can taki^ HtM-ies 
(hat arr rh.- rnsrh rn cumbin.Ml typos as subsorios to create oven more com- 
pb'x fon:,.. For rsamplo, (wo .snbsrrluH that arc iiUr rsprr fied mi>;hl them- 
scdv... b. Skip snbs.rlPs. U. On. ront of th. paper .uch complex sorla« will 
b^' caltrd "i-onibini'd typfs, " 

Tbi« powiT o( tliiH rombinirjii method can hv senn in the examples 

beluw; 



A r.Pl (A startinu witJi "A. " "a. B. C . I), E fr, , , 
and c:ol;NT ,slartint; with "1 , " Z, 3, .j, . , 

,\rv both assit;nod dlffimilty 1. 

'T'h'-* rntorspiTHf morion of (l)with 
"A. 1. n, a. C, I). . . and 
the C oncaionafc of (1) with 
"A I. I'..:, C'3. 1)4. . . . 

art- both assi^nod difficulty 3. 

The Skip on f!) accordinLt to pattern REPEAT of "1 and 2, " 
"A. 1,^ E. c;. M, J. K. . . . " 

has diff ic'^dtv I 5. 

1 1 



(1) 
(2) 



(3) 



(4) 



(5) 
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Cotuv:\HMirtti» of (*^) wUh (.U. 

"Al. l^**- ^''^^ • * * " 

..Al. Al. 1^^ C,*. 1)^ U^. • • • 

hftrt tUfllcviUy -to. 



(7) 



(H) 



SKipon(7).ccormn. to pnt.M. HKIW o( '^^ and^a.V 

I'Ai. n3, Hi. K'>. • • •" 

I, vory Ukcly unHolvable by «r,ul« .choot H.ud.n.H. 
Method 

..... ,ro«r«,n wa. av.Uable .0 .HO.ntH in ,r.... . U,rou«H^ 

,H m the Bchool. and n.ar,y proKramB wer. HVllnblc (BlocK. 
learnlnn arfSH In the Bcnooi. f.,..or 

after other work was completed. U«a(,i- n«" 
includfjtl about seven pu/zleii. 

\, »„n,.. r«ro.i.niod m ih«., protocol.. Olhcr d.l. 
Onl, .yp.d ".P°""" „p„.,lon.. o, dcLilod Um.n, 

,„oh vc,h.l„...ion.. ,= ..««.. ."■■> 

:;r:,r::-"r.::::;.:: 
::,::::r:::td . ...... .h.. 

p,:,::... «... — » -"-^ 

win be explained In detail. 
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There are benefits to focusing on the work of only one student as we 
; have clone in this paper. Most obvious is the wealth of detail available. 
Each of our goals can be evaluated for this student. The particulars of 
behavior have led to insighis about the learning process and have helped 
to formulate further research questions. A statistical study of all the sha- 
dents would mask many of the . relevant details. 

ITie student chosen for this analysis was among the 150 who used the 
Sfries program during its first operational year. At that time,- any student 
who wished to could select the program as a free activity as frequently as 
he or she desired. No supervision was available while the students worked, 
yo iheir performance reflects the motivational and instructional aspects of 
the program itself. This particular student* was selected because he was 
amon^^ the 25 most frequent users and. therefore, data accumulated on him 
was sufficienl lo make analysis meaningful. At the time, he was 10 years, 
11 months in age. iris 10 .score (117) was slightly above average for the 
school. 

The full protocol consists of work on I I 9 series in 241 minutes. For 
convenience of exposition, the work has been divided into four one-hour 

..ii^:srnen!^s^_a.i^ ,Khown_in ..Table 1 ■■ - — ■ — - 



Taljle 1 

Distntnillon o< Pu/zle"; Duriruj StucJunt's Four Hours of Series Experience 



Pu/7le numbers Number of 

puzzles/hour 



F»rst 



1 ■ 34 .34 



Second 35^64 30 

Tfi'^l 65 > 95 31 

Fourth 96 n9 24 
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The next two sections of the paper discuss tne clevclo,.nu.nl of ..ries-, 
solving and general problem-solving .kills, respectfully. Series are di- 
vided into two categories: (a) f^asic series, which include the alphabet and 
backward alphabet (ALPHA and DA1.PHA). counting (7, 8, 9, I*, • • •) 
both Toward and backward (COUNT and BCOUNT), and REPEAT series 
(P, F. F. F. . . .); and (b) applications of these Basic series to com- 
bined forms of varying complexity (Skip, Intersperse, Concatenate, and 
combined types). The student's knowledge of both of these categories is 
evaluated in the section on development of series-solving skills. 

Problem- solving skills in the context of Series will be described in 
terms of the following: (a) testing of hypotheses, (b) use of feedback from 
guesses, (c) gathering of additional data when needed, (d) consideration of 
all the data available, (e) choice of appropriate time to stop work on a 
series, (f) actions after groups of correct guesses, and (g) use of overall 
result on series for subsequent choice of new difficulty level. This dis- 
cussion of problem-solving activity is contained in a later section. 

Development of Serie s-Solving Skills 
„_...„This..section-documents the student's learning of series-solving 
skills, series are considered in the categories Basic, Concatenate, Inter- 
sperse, ^kip, and combined types. The student's work in each category 
will be described as it changed over time. 

In discussions of series-solving skills, a particular series is con- 
sidered "solved" when the student gets a sufficient number of terms right 
in a row. "Sufficient" takes on different values depending upon the series 
worked on. Series with a period of one, with no describable period, or 
with a very lengthy period generally require two right in a row to be con- 
sidered solved. Series with two or three terms in the period generally 
require the same number of correct responses in a row as there are terms 
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in a period. When the student understands part of a series, such partial 
solutions will also be considered and described. 

Basic Series 

The student made no errors in identifying and extending the Basic 
series ALPHA, BALPHA. COUNT, and BCOUNT during his first hour of 
work. He typically entered two or three correct responses in a row and 
changed to a new puzzle within one minute of work. Figure 2 illustrates 
the student's behavior on a puzzle involving Basic series. 





h A. 2, B, 


3, 






2, 


••• C 








3. 


1. A. 2. B. 


3. 


C, 




4. 


... 4 








5 


1, A, 2. B. 


3. 


C. 


4, 


6, 


... D 








7 
8. 


1. A. 2. B. 
CHANGE 


3. 


c. 


4. D. 



(Puzzle 5. Difficulty 41 / 

V y 

Note, Student responses j^e underlined. 

Figure 2. Student's behavior on Basic series in first hour. 

In all figures, student responses are underlined to distinguish them 
from computer actions. In Figure 2. line I shows the first five terms of 
the series as they were displayed for the student. Each time the student 
makes a correct guess, his guess is preceded by "^^'.'■■.'s " as represented in 
lines Z, 4. and 6 of Figure 2. 'this new, correct term is then appended to 
the previous terms. The revised displays of the series after each correct 
guess are contained in lines 3, 5, and 7. The student chose to change prob- 
lems after his third correct response, which is represented in line 8 by 
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..CHANGE." in the seHes illustrated in :..uro Z. ... stud... ..c..n..ed^ ^ 
^separate su.se.e. co.prisin, n.ain s...s. Ho identified an. 
.ended tHe., as COUNT and A.PHA series wUHou. error, ^.e s.den. e.- 
HiBited similar behavior whenever encountered tHe.e Ba.c ser.es. as 
.eU as BCOUNT and BALPHA series, be.innin. at rando. letters or nu. 
.ers. tHrou.Hout His Hrst Hour o. worU. THese Basic series were e.te d d 
ai«eren. contexts, including tHe interspersed ter.s in K.ure ^ and con- 
catenated terras sucH as "lUV . 99T. 98S, 97R " 

: Basic series were also applied as HypotHeses in xnore coxnplex ser- 

..y- T R T X . . " the student 
us For example, given the display "C, I. W, B. I. X 

. „c It is inferred that He analyzed the series 
guessed "A. " an incorrect guess. It is inlerre 

. ,,_ r. 11- "I I. . . . and "W, A, 
as containing three subseries: C. B ^ 

'euhse'ries. T.e guess. -A, " then represents a hypothes^.s that the first 
aubser- • is BALPHA beginning at "C" (C. B. A. . . . )• 

After t;,e first hour on Series, the student continued to recognize 
and extend the AI.PHA. BAI.PHA. COUNT, and BCOUNT Basic series. 

puring his first Hour on Series, the student recognized the identity 
relationship between ter.s and solved KEPEAT series. He was success- 
ful in solving all KEPEAT series He encountered, ^ose ^e^^^^s included 
3eries With fro. a tola terms in a period. ----^ '^l^^,, 

PEAT series he saw repeated after U terms, r^e student used NEXT 
ifne als in a row until two terms appeared which were identical to the 

1 series. It is inferred from this behavior that the student recognized 

identify relationship and proceeded t. extend the .eries by enter.g 
.i.hse.uent terms as they appeared earlier in the serie. A series con- 
ainin KEPEAT as a subseries was extended and solved with_out error 

,.r n T V r T W . . . ; and I, H, V, M, 
six terms in a period (C. I. W. B, I, X, C I. ^ , • 

H. W. 1. H, V. . . .)• 

12 
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In his second hour of work, the student extended a series requiring 
the repetition of a three-element term. Each term was formed by the con- 
catenation of three REPEAT subseries: "I, I, I, . . . "gs^ gS, 85 
and "Or O. O, . . . giving the final appearance, "I850, I850, I850, 
. . . . " Fie made no errors extending both a single-element repetition 
(16, 16, 16, ... ) and a Concatenate series with a subseries of two re- 
peated symbols (-Q, +R, -S. +T, . . . ). An Intersperse series similar 
to those solved in his first hour of work was extended with no errors (1, X, 
2, X, 3, . . . 

The student continued to solve REPEAT series when he encountered 
them in hours three and four. In addition, he incorrectly hypothesized the 
existence of REPH:AT patterns in seven series. Typical behavior in the 
student's third hour on Series with a REPEAT pattern is shown in Figure 3. 
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0. 


B. 


0, 


0, 


B, 


P, 


0, 


B, 


0, 0, 
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(Puz/Ie 87, Difficulty 17) 



Figtire 3. Studer^i's behavior on REPEAT series in Ihird hour. 
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All student' responses are underlined, while computer actions arc not. Cor- 
rect responses are preceded by as described for Figure 2. In addx- 
tion Figure 3 contains incorrect guesses. These are the underlined terms 
in lines 2. 5. and 6. It is inferred from his first guess. "P" (line 2). that 
the student iniually hypothesized a REPEAT series with three terms (O. B, 
P) in the period. When this hypothesis proved incorrect, he typed "NEXT" 
for additional information (lir.-> 3). Both previ.u. tinnes that "O.. appeared 
in the serie.. it was followed by "B. " Tke subseq. .nt.guess of -B" implies 
that the st.,de,,t hypothesized another instance of the "O. B" sequence (line 
5). It IS inferred that the studenf s next two guesses. ..p" and ..O- (lines 
6 and 7). were hypotheses that the series consisted of the letters "O. 
MB. " and "P" only, in some pattern. It is reasonable to assume that "P" 
wa', guessed before "O" becaus. there was no previous instance of two 
identical letters in a row. When the "O" proved correct, the student hy- 
pothesized that the series was a REPEAT series with six terms (O. B. P. 
O B O) in th^ period and correctly extended the series by seven addi- 
tional terms (lines 8 through 20). This protocol provides evidence of the 
student's ability to recognize the identity relationship and to hypothesize 
various REPEAT patterns in a series. 

Concatenate Series 

concatenate series are those in which terms from two or more sub- 
series are written next to each other to form a single term of the mam 
series. When the subseries contain different symbol sets, usually num- 
bers in one and letters in the other, the contrast between subseries is high 
and the Concatenate is easier to solve. When the contrast is low or the 
subseries are more complex than Basic series. Concatenate series are 
harder to solve. 

Throughout his series history, the student made no errors extending 
concatenate series composed of the contrasting Basic subseries: COUNT 
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or BCOUNTwith ALPHA or BALPHA; and REPEAT of with ALPHA 

or COUNT. Series solved without error included "lA, 2B, 3C, . . . 
100U, 99T, 98S, . . .'-and --1, -f2, .3. . . . In this third hour, the 
student encountered two Concatenate series that presented some dUficuIty 
for him. The first consisted of two REPEAT subseries with different length 
periods: REPEAT of "R. S, T" and REPEAT of ''B, 4, 5, 6, 7. " His solu- 
tion of this series appears in Figure 4. From the student's repeated guess, 
"T8" in 1- es 2 and 3, he clearly recognized the repeated "R, T" sub- 
series and hypothesized the second subseries to be a COUNT series. He 
often guessed the same term twice whan p, hypothesis was strongly implied. 
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S4. 
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T6. R7 






S3 

















[Puzzle 89. Difficulty 9] 



Figure 4. Student's behavioj on Concatenate series in third hour. ^ 

The student asked for the next term (line 4), which was "T3. " This re- 
vealed the student's hypothesis about the first subseries to be correct and 
the second subseries to be a REPEAT pattern as well. The student pro- 
ceeded to extend the series successfully, entering the correct term, "S3, " 
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at line 14 when the second subseries started a new period. He coatinued 
entering correct tern.s through a third start of that pattern before typing 
"CHANGE." 

A Concatena-.e series that the student did not solve contained a Skip 
ALPHA subseries (every third letter) and a BALPHA subseries (WJ, XI, 
CH, FG. . . . ). The student's guesses always contained a correct exten- 
sion of the second subseries, but he could not extend the first. 

Skip Series 

Skip series exhibit wide variety because t>e-pattern by which skipping 
occurs within one subseries is controlled by a second numeric subseries of 
arbitrary complexity. The first subseries can be either alphabetic or nu- 
meric- the magnitude of numbers involved can vary widely: the direction ot 
skipping can be either forward or backward: the number of terms in a p.r.od 
can be one. two, three, or even higher: and the amount to skip can change 
significantly. Each of these factors contributes to the difficulty ot the solu- 
tion. The student-s work will be traced acro.s time in several catego..e. 
suggested by the distinctions drawn here. 

in alphabetic Skip series, the student made no errors when every 

• ic TT w Y A . ..." He had more 
other letter was skipped, as in 'S. U. W . Y . A. . • 

difficulty with skipping t^o letters. He fir.t encountered a series of this 
type as a subseries of a Concatenate series. His guesses indicated that 
MS hypothesis was a skip of only one letter, and he could not solve it at 
that point. TVo puzzles lat^r' (see Figure S), the student did solve this 
scries when V.e encountered it out of the Concatenate context. H.s first 
„„ess. "A" in line 2. implies a hypothesis that ^he series skipped only one 
letter, but he then extended the series successfully. Tae n.xt time.he saw 
this type of series, the student extended it without error. 
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1. M. P. S. V. Y. 

2. A 

3. •-- B 

4. M. P. S. V. Y, B. 

5. -•- R 

6. M. P. S. V. Y, B. E, 
... H 

B. M. P. S. V, Y. B. E. H. 
9. ..• K 

10. M, P. S. V. Y, B, E. H, K, 

11. CHANGE 

(Puzzle 92, DItficul'v 23) 



Figure 5. Student's behavior on alphabetic Skip series in nird hour. 

During his first hour of work, the student made no errors solving 
numeric Skip series that increased or decreased by a constant amount. 
These included series starting at from 1 to 94, wi;h dUferences between 

terms from 3 to 110. e.g.. "3. 6, 9, 12 and "64, 131, 198. 265, 

. . . .'^ One puzzle solved without error was based on backward counting: 

"94, 9i). 86. 82 A series in which each term was doubled to form 

the next was extended as v/ell (1. 2. 4. 8. 16, . . . ). 

In his second hour of work, the student pcWod a BCQUNT Skip series 
with a difference of 54 between terms without error: "4989. 4935, 4881, 

'^^^^ " also solved a series beginning at 484 with a difference 

of 10 between terms. However, he made arithmetic errors on some series 
he previously solved without error, series which started at 2 and 3, increas- 
ing by S and 6. respectively. He also made arithmetic errors on a series 
beginning at 5955 and decreasing by 75. 

Figure 6 shows his behavior on another series which was also at a 
difficulty level he previously solved. Instead of consistently adding the 
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eo„ect dU£erence of 8 between tern,s. d.e student added 5, 7, .7. ..d 18 : 
-:;;Le,4. S. n.ana U iUneS contains t.e student. t.po..apMcale..o.,. 



"A 



1. 7. 15. 23. 31. 39. 

2. 51 

3. 7. 15, 2'., 31. 39. 47. 

4. 52 

5. 5 

6. 55 

7. 7. 15. 23. 31. 39. 47. 55. 

8. 62 

9. NEXT 

10. 7. 15. 23. 31. 39. 47. 55. 63. 

11. 80 

12. 81 

13. 11 

14 7. 15. 23. 31. 39. 47. 55. 63. 71. 

15. 79 

16. 7. 15T23. 31. 39. 47, 55, 63. 71. 79. 

17. CHANGE 

(Puzzle 63. DiffiCullY 13] 



Figure 6. Student's behav.or on numeric Skip series 



with constant increment in second hour. 



Ms third ho.u. the student continued to extend without error K.p 
.„.s witH co.stant dU.erences be.innin. at numbers > to ..wU. d. er- 
Lces o. n,a.nlt.de . to 1«. He also n,ade no errors on SV . ser.es or 
BCOU.T sta..n. at ZZ6 and 884. witH differences 8 and H. respect.elv 
Ourin, HIS final Hour on Series, the student n^ade no errors soWin, 
... ..innin. at . and increasing W ^ and .e.innin. a. S an .c... 
ing by 100. He did n,ake son,e arithrnetic errors on. but 
starting at IZ wltH a dUference of 16 bet^-een terms. 
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A Skip series which the student did not solve is shown in Figure 7. 
The student never added the correct difference of 8 to a previous term; 
instead, his guesses were incremc:nts of 18, 10, and Z (lines Z, 3, and 6). 



1. 348. 356, 364, 372, 380 

2. 398 

3. 390 

4. NEXT 

5. 348. 356, 364. 372, 380. 388, 

6. 39fJ 
N EXT 

8. 34B. 356, 364. 372, 380, 388, 396, 

3. CHANGE 



[Puzzle 100, Difficulty 21) 



Ftgure 7. Student's behavior on numeric Skip series with constant increment in fourth hour. 



Numeric Skip series with period two skip by a repeated pattern of 

two number:, such as "2. 3, 2. 3. 2. 3, . . . " or "3, -1, 3, -1, 3 

The sizes of the i iitial number of the two repeating numbers determine the 
difficulty of the ^ fries. In his first hour of work, the student made no 
errors extending numeric Skip series of period two that started rt numbers 
less than 10 and increased or decreased by differences of 5 or less (both 
differences of the same sign), such as "6, 7, 9, 10, 12, , , . All other 
such series throughout his history were also solved without error. 

In his first hour, the student made some errors on, but solved, all 
numeric Skip series of period two which started at numbers up to 100 and 
generated terms with any combination of positive and negative differences 
of 7 or less. Typical behavior on such series appears in Figure 8. This 
series begins at 100 and decreases by alternating value of 1 and 2. The 
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student entered two correct terms (lines 2 and 4), decreasing the previ- 
ous term by 1 and 2, but then decreased by 2 again out of the proper se- ; 
quence. Evidence such as this implies the student's understan^Ung of the 
conceptual principle of Skip .cries with period l^o, but a tendency to lose 
track of his position within the period. During the rest of his Series his- 
tory, the student solved most such series without error. 



1 99. 97. 96. 94, 

2 .-- 93 

3. 100. 99. 97, 96. 94. 93. 
4 9] 

5. 100. 99. 97. 96, 94, 93, 91. 

6. 89 

7. CHANGE 



[Puzzle 14. Difficulty 121 

V__ 



F.gure 8, Student's behav,or on numer.c Sk,p sencs with per.od two in f,rst hour. 



The student did have difficulty with one series in the fourth hour, 
as illustrated in Figure 9. Although he had solved puzzles similar to 
this without error, he had difficulty keeping track of the p-riod here. 
This series decreased by alternating values of 1 and 3. The student 
erred by using the wrong difference in lines 2 and 8 and by using the 
wrong .ign of difference in line 3, but he then entered five correct re- 
sponses in a row, demonstrating a correct alternation of difference 
values. 
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IP-j.vIe tfli, Difficulty 12) 



Figure 9, Student's behavior on numeric Skip series wuh period two in the fou.th hour. 

In his .second and third hours, the student encountered, but did not 
solve, numeric Skip series of period two that started with numbers of mag- 
nitude up to \H For example, one series started at 6 and alternately 
increased by values of IS and 39. He used the differer.^c value 18 to enter 
one correct term, but tried the same value again for the next term. In his 
fourth hour, he did solve without error a series beginning at 473 with dif- 
ferences between terms of +6 and -7. That series. »'473, 479, 472, 478, 
471. 477, .... "may have been solved as an Intersper?e of two BCOUNT 
subseries. 

Numeric Skip series of period two with multiplicative differences be- 
tween terms were difficult for the student. He solved .one such series 

25 



,er.,. were .ene.a. W aUe.na.elv .ulUplyin^ W . and aad.n« 3 
seven we.. aUe.pUa. no o.Ke. .e.es wUH .uU.pUcaUve 
" ences were solved in the ren^ainder of the student's Se„e. worK. l^e 
student tvpicaUv dUa-.ences as addUive instead or .uUipUcat.ve .n 
these series, as illustrated in Figure 10. 



1 1. 2. 3. 6. 7. 

2- ]I 

3 8 

4. NEXf 

5. 1. 2. 3. 6. 7. 14. 

6. 1^ 

7. 1. 2, 3. 6. 7. 14. 15. 
8/16 

9. 11 
10 NEXT 

1. 2. 3. 6. 7. 14. 15. 3(^. 
12. CHANGE 

[Puz/le 93. Ditficutty 24) 



« ir<;w.n«ri« With period two fcuuuing 
F.qurelO. Student's hehav>o. en nume- ic Sk.p senes w tn p 

multiptication Ml thud houi. 

, .He series in K.ure 10. tern.s are generated hy alternately n.ulti- 
... , The resulting dUferencc. between the five tern.s 
plying by 2 and adding 1. Ihe rt.uUing ^ , , The stu- 

origi any displayed Tor the st.dent (line 1, are all either 1 or 3. The t. 
Lfs first two guesses. ...O" and (lines Z and 3). were incren^ents 
dent s first tw , ^^^ .j^. since these guesses 

from the last term. of 3 and 1. P tje euesso.? 

.ere incorrect, the student asKed for additional information. He gue 
: (line e). an increment of 1 from the new tern., which was correct. 
„l gue. was also an increment Of 1 (line S). but a^mul^^^^^^^^^ 

operation was required, and his guess was incorrec ^ ^ ^ ^^^^^^^^ 
guess of "21" (line 9) was most likely an increment of 
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his perception of the "7, 14" sequence as an addition of 7. With the addi- 
tional term provided by his request for "NEXT. " he still did not perceive 
the multiplicative relationships between 3 and 6. 7 and 14, and 15 and 30, 
and chose to "CHANGE." 

Numeric Skip series with period three use three different increment 
values and are more complex than those with period two. In his first hour, 
the student encountered the only period three Skip series he ever solved, 
llie series started at 9 and increased by three positive differences, 1, 2, • 
and 3. He solved this series without error (9, 10, 12, 15, 16 18 21 
. . . ). This 'repeating pattern of differences (1, 2, 3,1, 2, 3, 1, , . .) 
is smong the simplest possible. An earlier puzzle of differences was 

"1. -2, 3, 1, -2. 3, 1 " The student made errors of - ign and mag- 

nitmie and entered only one correct guess before changing to a new series.'" 

In his second hour of work, the student partially solved a series with 
terms and differences of greater magnitude than those ii, his first hour. 
This series is shown in Figure II. This series has differences between 
terms of fl4. -5, and -I 2 1 . The student's guess of "62" (line 4) was an 



1. 12. 26. 21, 42. 56. 

2. NEXT ; 

3. 12. 26, 21. 42. 56. 51. 

4. 62 

5. ... 72 

6. 12. 26. 21. 42. 56. 51. 72. 

7. ... 86 

8. 12. 26. 21. 42. 56. 51. 72. 86. 

9. CHANGE 



[Puzzle 36. Difficulty 33) ^ 



Figure 1 1, Student's behavior on numeric Skip series with period three in second hour. 
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.„cren.ent o. U iro^ the previous tern. T^.s was n,ost UKely a ,uess ■ 
.ase. on an arU.n.e.c e»or. .or t.e student tHen added tHe co-e.ct .ncre 
.ent o. ZI. He again incremented correctly by U .e.ore typ.n. ' CHANCE, 
^e student did not enter enough terms £or complete Judgment o£ h.s un er-.,„ 
standing o. tMs series. He could not solve tHe only oU.er S.ip serUs o 
period three he encountered, which started at,494 and had deferences 
+15. -5. and -8 between terms. 

Intersperse Series 

intersperse series are formed by taking individual terms o£ the main 
ee. .alternately from a set o£ two or more subseries. ^e dU£iculty o£ 
an intersperse series is controlled by the contrast between the subser.es 
and the dUHculty oi the component subseries themselves, ^roughout h. 
.our .ours, .he student made only one incorrect guess while ^-"^ - 
.perse series oi period two. with one subseries alphabet, and the other 

. , V 7 7 . . . " The subseries 

numeric. A typical example is ' X. b. -> • '• " 

T- Wd REPEAT COUNT, and ALPHA. The student made no errors 
used mcluded REPEAT. COUr. , • „„e REPEAT and one COUNT 

extending a series with two numeric subseries, one REPEAT 

(9. 1«. 11. 9- 12. . . • )• 

A series with three interspersed alphabetic subseries was encoun- 
tered by the student. His wor. on this series appears in Figure U.^he 
series In Figure U consists o£ three subseries: ALPHA beginning at E. 
.LPHA beginning at "V. and REPEAT o. the letter .^M. U may be,n-^ 
,erred .om the s.denfs guess (Une a, that he ^ ^ " 

or three subseries and hypothesised that U the first two were ALPHA 

was as well. When this proved incorrect, he as.ed .or more in or.a 
.on. He then extended the Urst two subseries correctly (lines 3 and 7, and 
typed ..CHANCE. - U is likely that the student understood the entire ser.es. 
Jut the protocol does not contain an extension o£ the third subser.es. 
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1. E, V. M, F. W, 

2. N 

3. NEXT 

4. E, V. M, F. W, M. 

5. G 

6. E. V, M, F, W, M, G, 

7. X 

8. E, V, M, F, W, M. G, X, 

9. CHANGE 



(Puzzle 45, Difticutty 40] 



Figure 12. Student's behavior on alphabetic intersperse series with period three in second hour. 

Intersperse series with numeric Skip subseries presented greater 
difficulty for the student; he did not solve any such series he encountered. 
Typical student behavior on an Intersperse of two numeric Skip series 
, appears in Figur** 13< The first subseries of the Intersperse series is a 
Skip series beginning at 68 and Increasing constantly by 4; the second be* 
gins at 48 and increases constantly by 3. The student's first guess, "81", 
(line 2), is an increment of 5 from the last term. This difference may 
have been extracted from the difference between the last digits of the previ- 
ous two terms, 51 and 76. His next guess, "56" (line 3), was a decrement 
of 20, the first difference in the main series (between 68 and 48); his final 
guess, "100" (line 4), was an increment of 24, the second difference in 
the main series (48 to 72). None of the student's guesses imply a recogni- 
tion of an Intersperse pattern. However, when two such numeric Skip 
series were interspersed with an alphabetic subseries, increasing the con- 
trast among subseries, the student did successfully extend the alphabetic 
s^eries. 
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1. 68. 48. 72. 51. 7G. 

2. 8] 

3. 56 

5. CHANGE 



(Pu//le 44. Difficulty 391 



Fiuuro 13. Sludenl's behavior on numeric Intersperse series with Skip subseries in second hour. 



Typical student behavior on an intersperse of tsvo alphabetic Skip 
subseries appears in Figure 14. rhe two alphabetic subseries are: "T. 
Y D ..." and "V. Z. D. . . . they skip by five and four letters, re- 
spectively. The student never saw alphabetic Skip aeries with such large 
increments as a main series, so the series in Figure 14 proved difficult. 



V T. V, Y. Z. D, 

2. E 

3. F 

4. NEXT 

5. T. V, Y. Z. D. D. 

6. T 

7. CHANGE 



IPuzzle 109. Ditficultv 50) 



Figure 14. 



Student's behavior on alphabetic Intersperse series with Skip subseries in fourth hour. 
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His first two gvicsscs, "E" and "F," are local increases from the fifth 
term "D. " l1ie uso oi "NEXT" is excellent. student's next guess. 

"T," stems from a hypothesis that the series repeats from its first term, 
lliroughoiit his work^on the series, thu student shows no awareness of the 
Intersperse pattern in the series. 'iVo other Intersperse series presented 
similar difficulty for the student. 

Tlie student made some progress toward solvin;^ a period four series 
containing REPEAT and Skip subseries, as illustrated In Figure 15. The 
series has many confusing terms, but can be decomposed into four simple 
stibseries that alternate. The first rupeats 6; the second repeats 7; the 
third skips counting by a constant 7 (7. 14. 21. 28. • . . ); and the fourth 
repeats 7. EJight of the twelve guesses before line 24 in Figure 15 were 
"6" and '*7, " the numbers that are repeated in three of the subseries and 
are correct for nine of the first ten terms. The remaining four guesses 
are governed by more local patterns. The guess of "8" in line 6 is gen- 
erated by a counting liypothesis beginning with the subseries "6, 7, .... " 
A similar counting appears with "15" in line 10. Here the hypothesis is 
more complex, involving the fact that counting occurs elsewhere. Some 
av -.. ,.nc»s * o^^ rhe periodicity may therefore be in evidence as early as line 
10. The gutiss of "14" in line 11 recognizees that terms sometimes are 
repeated after themselves. Finally, the guess of "14" in line 20 recog- 
nizes the local subseries "6. 7. 6. 14. 6. 7. 6. . . . " as a possible re- 
peating pattern with period four. After line 22. four of the next five 
guesses are correct, 'Vhc error comes from anticipating "28" too early, 
losing track ot which subi?eries is in control. The student stopped working 
at this point when his understanding is still in doubt, but he has made 
excellent progress on the series. 
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\. 6. 7. 7. 7. 6. 

2. 6 

3. 7 

4. 0, 7. 7, 7. 6, 7. 

5. Z 

6. 8 

7. i 

8. NEXT 

9. 6. 7, 7. 7. 6. 7. 14. 

10. 15 
li 

12. NEXT 
»3, 6, 7. 7. 7. 6. 7. U. 7. 
14. I 
15 NEXT 

16. 6. 7. 7. 7. 6. 7. 14. 7. 6. 

17. 7 

18. 6. 7. 7. 7. 6. 7. 11. 7. 6. 7. 

19. 2 

20. ]± 

21. 6 

22 NEXT 

23. 6. 7. 7. 7. 6. 7. M. 7. 6. 7. 21. 

24. 7 

25. 6. 7. 7. 7. 6. 7. 14. 7. 6. 7. 21. 7. 

26. 6 

27. 6. 7. 7. 7. 6. 7. M. 7. 6. 7. 21. 7. 6. 
■ 28. 28 

29 • • • 7 

30'. 6. 777. 7. 6. 7. 14. 7. 6. 7. 21. 7. 6. 7. 

^3;: ;:'7.-7.7.e. 7. 1.7. a. 7... 7.a.7...B. 
33. CHANGE 

(Pu2zle 84. DitticuItY 21) 



Figu 



,e ,5. Student's beh.v.or on numeric Intersperse series 



th period tour in third hour. 



'} 9 
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Combined Types 

llMi increasing increment series are related to Skip series. Instead 
of increasing by a constant amount or by a repeating pattern of differences, ; 
the amounl of increase is itnel!' a Skip series. For example, in the increas- 

ing increment aeries "1, 6, 13. Z.>, 33, 46, 61. 78 "the subseries 

by which terms increase is "5, 7, 9, H, 13, 15, [7 n 

The student encountered, but could not solve, three increasing incre- 
ment series in his first two hours on Series. Of these, the most interesting 
is illustrated in Figure 16. The increments in the puzzle increase by dou- 
bling. "5. 10. 20. 40. 80. 160, 3Z0 M Tlie student's guesses show 

little awareness of the pattern. Some information has been assimilated, 
though, for most of the student's guesses end in the digit "6, " as do all terms. 



1. 6, 16, 36, 76, 
126 



1. 
2. 
3. I 
A. NEXT 

5. 1, 6, 16, 36. 76, 156, 

7. NEXT 

8, 1, 6. 16. 36. 76. 156. 316. 
9 436 

10. 336 

11, NE.XT 

12. 1, 6. 16. 36. 76, 156. 316, 636, 

13, ^J76 
876 

lb. CHANGE 



\Pim)t! 46, Difficulty 41) 



Fjqufo 16. Student's hohavior on incrpasing nicrement series with multiplicative Skip 
subsertes m second hour. 
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,.,26" (line 2). Is an Increase of 5(4 from the previous 
The first guess, "12& (Une<:), i u„ „uefiB08 "436, " 

„f 4(4 Only at line 9, when he guessos 
term where the increment was 4«). Unly . . 320 does 

34/above the previous term where the previous increment was 320, 
.He student show similar awareness of the lnc.easln« Increment. 

:„ His fourth hour, the student a«aln encountered an increasing in- 
. • s The series started at 0 and had the difference series 
crement series, -^eserie „ clear from the student's 

„c ,0 15, 20, 25, . . ." (see Fvgure 17). It is clea 

• „• 2 4 and 6) that he analy/.ed the progression 

tir^t three responses lines 2, 4. ana oj 

first three re p required, 
of differences correctly and incremented by 25, 30, 
L lost trac. Of the differences and incremented by 35 to guess .75 in 

he immediately corrected himself. ..ere is no obvious explana- 
, r 1, but the student entered the next term cor- 
tion for the error in line U . but . earnlna occurred 

rectly and did solve this increasing increment series, .earning 

in this class o£ series. 



1. 0. 5. 15. 30. b0. 

2. •••75 

3. 0, 5. 15. 30. Sji, 75. 

4. *•' 105 

5 0, 5. 15. 20, 50. 75. ipf5. 

6. •"110 

7. 0. 5, \b. 31^. 50. 75. 1^. l¥ 

8. 175 

9. ••• 180 

10. 0. 5. 15. 30. 50. 75. 1^5. 14^. 18J^. 

11. 126 

12 '•• 225 

13. i/, sT^. 30. 5^, 75. lCr5. iV. I8f^. 225. 

14. CHANGE 

[Puzzle 106. Difficulty 24] 



Figure 17. Student's behavior on mrrcasing 



increment series with additive subscries in fourth hour. 
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Series with Increasing perlocl, a second combined type, are those 
In which the period getH longer as the series progreasea, for example, 

••Ij 2, 2, 3, 3, 3, 4, 4, 4» 4, 5 " The student encountered one 

such series in his first hour of work (6, 7, 7, 8,8,8.9,... ). Given 
the first five terms of this sorles, the student guessed "9'* twice and 
changed puzzles. 

In his fourth hour, the student again encountered an Increasing 
period series. His solution appears in Figure 18. The student's first 
gueM> . "F" (line 2), was a hypothesis that each letter repeated twice, 
disregarding the first, single, letter. Notice the similarity to his guess 
of "9" on the puzzle just described. His second guess, "C" (line 3), is 
generated by a hypothesis of a REPEAT of all five terms. He then guessed 
"E" (line 4) and *'F" (line 6) and extended the series successfully for eight 
additional terms beyond those shown in Figure 18. Learning has occurred 
on Incr^'aslng period type series. 




2 

3. 



C. D. D. E. E. 



C 



4 



E 



5. 



C. D. D. E. E. 



6. 



P 



7 



C. D. 0. E. E. E. F, 



(conlinued for 8 more cortect terms) 

[Puzzle 1 15. Oitficulty 151 



Figure JB. Student's l>ehavior on alphabetic increasinq period series in fourth hour, 
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9..n,miirv of Se rUH-Solvlng Skill Development 

Protocol analyHls provides evldonco of the Htudent-a entering knowl- 
edge of n.e Da«lc «erl08 COUNT. HCOUNT. ALPHA. BALPHA, and RE- 
PEAT. Thene Basic series were recognised and extended correctly when 
encountered alono or as subseries of Intersperse and Concatenate series 
throughout the student's history. 

The stxtdent entered with the ability to concatenate two Hubseries to 
extend main series; he successfully extended all Concatenate series en- 
countered which were composed of contrasting Basic series (letters with 
numbers, or numbers with the signs "4" or "-'•). Evidence of learning 
appears in one of these series with which the student had some dUflculty 
(see Figure 4). It is clear from this protocol that the student learned to 
keep track of two REPEAT subseries of different lengths and to concatenate 
them according to his current position in each repeating cycle. TTiis learn- 
ing represents both a specific series- solving skill and a more general 
problem-solving skill; the student has decomposed the problem, solved 
each subpart, and recombined the separate solutions to produce a solution 
of the full problem. 

Only one Concatenate series remained ultimately unsolved in the 
student's history. Since one subseries was beyond his^ se ries -solving 
repertoire at that time, this puzzle was too difficult for the student. 

The majority of series the student saw were of the Skip type. These 
varied widely in difficulty depending on factors discussed in the section on 
Skip series, and were either numeric or alphabetic. Alphabetic series 
that skipped every other letter provided no difficulty, but the student 
struggled to his eventual solution of series that skipped t<vo letters be- 
tween terms (see Figure 5). 
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NuhKTlc Skip HorloH with u period of one wore aolvvd throuKhout the 
stmk'Ml'H Serii»H rxporieiico. Arithmetic errors were mndu in adding or 
Hubtracllng tht* c:on»tant dlll'ert.MCCM between terms In thoHe aerlea, but the 
HtVKlent undernlood the concept involved. Seriea .solved started with num- 
bera between 1 and 595') and Increased or decreased by values from 3 to 

Numeric Skip aerios with a period of two skip by a repeated pattern 
of two numbers that ar»> either both positive, both negative, or of mixed 
si^ns. 'Ilu' student solved almost every series of this type that he encoun- 
tered. I^videncc Implies that the student understood the conceptual basis 
of th« Skip series with period two, although he often made arithmetic errors 
and occa.sinnally lost track of his position within the period of some aeries. 
Tlie student's main difficulty with these series arose when difference values 
exceeded Z^, 

MnlfipHcative Skip s?erins, in whi^h ihc terms are alternately multi- 
plied by a number and either increased or decreased by another number, 
proved difficult for the student. Although he solved one such series in his 
first hour of w.-,;-k. tlu.' student typically saw differences as additive instead 
of multiplicativ't% 

One numeric Skip series with a period of three was solved by the stu- 
dent, 'lliis series started at 9 and increased by the repeating pattern of 

^' ^' ^. I " Proi;re.ss waw made toward solution of a 

series with terms and differencoi; of greatf:r magnitude and mijced signs, 
but the student stopped too soon for complete judgment of his understanding. 
ISvo perif>d three Skip series were not solved. KVidencc for the student»s 
understandint: is inconclusive. 

Intersperse series of period two with contrasting; Basic series (one 
alphabetic and one numei ic subserles) were solved consistently by the 
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.e««ful on an seH.. wUH two nnnu... «ub«evi.« t,... alphabetic .uU- 
,erlc, Uut ha. dimcul.y wUh i.Uor«per«e.l SKip .uU.>rio« of low .ontran 
U app«a.-a tH«t when tlu- lnto.«pe..on was ..a.Uy po.ceWo... t . .tu o.U 
Jl eac. .u...rU.s an.. co„,Uin.. tH.n, to .o.vo tU. n.aln «e.U.. How- 
over. When the intersperslo,. waH not «u««o.tea Uy the l.n.e.Uate appear- 
ance of the series, the stuOent dUl not hypothesise the cxUtenco of In-.r- 

.uKn« hU series experU-nee, the student learned how to solve series 
.l.h -.creasing lncre,nents. In the three series of this type seen in . 
«.uaent.s second hour of wor.. only nninor evidence of awareness of t e 
.as found. . fourth series, seen in the stu en s 
fourth hour of worR. was solved usin« the correct progression of 



ences. 



A second con.blnod type, series with increasing period, was not 
solved bv the st.>dent when first encountered. In his second exposure to 
IL type Of series, the student wor.ed out the correct solution. U-arn., 
occurred on increasing period serlefl. 

^rou,hout the discussion of series-solvin^ sBlls, we have inter- 
preted the data as conservatively as possible, ^us. if no errors were 

a series we inferred that the student knew how to do that ser.es 
n,ade on a senes. ^e inl seen., likely that a less con- 

when he began his work on the progran.. It seerns y 
.ervative interpretation would be justified., so.e learning that occurred 
,.Hn« work on the preceding series helped In solving the new one. Th re 

no way to determine the facts fro. the data in hand, and we choose to 
present the data cautiously. 
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Developniont of Probloin-Holvinjj SkillH 



71iiH Hfction dt»«cribeM tht! student's dovolopment of problem-solving 
skills, Including} (a) testinj; of hypothos«8, fb) ubo of feedback from 
guesuoH, (c) gathering of additional data when noedod, (d) considoration 
of all of the data available^ (e) choice of approprlflt« time to stop work on 
a 8crlca» (f) actions after groups of correct guesses, (g) actions after In- 
correct guesses, and (h) use of overall results on series for subsequent 
choice of new difficulty level. 

First Hour 

Substantial changes in the student's problem-solving behavior oc- 
curred within the first hour of work. Overall he chose difficulties Increas- 
ing steadily from 1 to 31 with one exploration to difficulty 50. This Infor- 
mation Is summarized In Table 2 along with similar data for the other 
three hours. 



Table 2 

Percentage of Puzzles Selected m Each Difficulty Range for Each Hour 



Hour 



Difficuiry Range 


1^ 


2b 


3«= 


4^ 


1 - to 


32 


30 


39 


33 


n • 20 


29 


13 


26 


21 


21 30 


32 


7 


19 


29 


31 ■ 40 


3 


33 


3 


4 


41 . 50 


3 


17 


13 


12 




^n * 34 


- 30 


« 31 


= 24 



35 

29 



,n hlH flrH. hour, the Hiudcn. va«BCcl .'.^ oC llu- .U .orl..» lu- naw with 
no crrorK al all. and pa-Hcd i- of llu, remaining U ultor n.lnor .-rro... 
-l-hcrefore. hln gradual IncreUH. of difficulty .n«y roprcBent a too couHorva- 
H.e u„o of ,h. feedback on hi. ov-rall ro«ult,.. On tho a2 H.rlOH hoIvcI 
without error, he ehoH« appropriate tln>.= H to chan«« pr.unom. after ho 
knew the solution. The U HerloH with which he had .llfflculty provide in- 
sight into his other problem- solving skills. 

On a series which presented difficulty in the early part of the hour-s 
work, the student typically behaved as Illustrated l» l igurc 19. After 
making two Incorr.ct guesses (lines 2 and 3>. .he student changed to a new 
Hrrl-H. -nu. siudcnl was testing a reasonable hypothenls but did not use 
U.e feedback that h,s first guess was Incorrect; he made the same guess 
twice. He did not atten.pt to gather addition.".! data which may have led to 
a solution and did not consider all of the information available, that Is. he 
disregarded the fact that the first term appeared only once. Hi. problen,- 
solving repertoire seems limited. 



1 6. 7. 7. 8, 8. 

7 i 

3 9 

4. CHANG£ 



[Puwle 16. DifficultV 1*11 



Figure 19. Poor usr of feedback m first hour. 



Another example of the student's early repertoire is illustrated in 
Figure 20. TH. student entered one correct response (line 2). made three 
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plausible, but incorrect, guesses, and changed. He did not request addi- 
tional data. The student changed without asking for the additional data 
that might have been helpful in two other series during the first hour. We 
infer that the student did not recognize the utility of typing ■■NEXT" to get 
help until after Puzzle 24, although he had used it in Puzzle 2 where he 
typed ■■NEXT- nine times in a row until he noticed that the last two terms 
were repetitions of the first two. He then proceeded to extend the REPEAT 
pattern. T^is was the only use of ■■NEXT^^ until 52 minutes into his first 
hour. 



2. •.. 4ef 

3- h 10. 2. 20. A, A^f, 

4. 5 

5. 6 

6. 3 

7. CHANGE 



fPuzzle 21, Difficulty 19] 



Figure 20. Failure to seek additional data in firsi hour. 



Figured! illustrates a new step in the development of the student's 
skills. Olie. student was faced with three interspersed subseries, one 
alphabetic ancJ two numeric series. He tested tv^o hypotheses and then 
typed HNEXT-' (line 4). TT.is was an' appropriate time to ask for new data 
since feedback indicated his two hypotheses were incorrect. He correcdy 
extended the alphabetic subseries (line 6) but then typed "CHANGE. •» He 
did not do any more work toward extension of the two numeric subseries, 
once again stopping before trying every possible strategy toward solution. 
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1. L. 98. 32. M. 95, 

2. 29 

3. 0 

4. NEXT 

5. L. 98. 32. M, 95, 35. 

6. N 

7. CHANGE 

[Puzzle 29. Difficulty 26] 
Figure 21. Seeking additional data in first hour. 



A more effective strategy is seen in Figure 22 where the student 
asked for an additional term (line 2) as soon as he saw the original display 
in line 1. We infer from his guess of "A" (line 4) that he hypothesized the 
series was comprised of three subseries. the first of. which (terms 1. 4. 
and 7) was BALPHA beginning at "C. " He sought more information after 
receiving feedback indicating that his hypothesis was incorrect. Thxs new 
term. (line 6). revealed the possibility of a REPEAT pattern, and the 

student hypothesized the next term to be.-I" (line 7,. Tl.is was correct 
and the student proceeded to use all of the data available to him to extend 
the series for five correct terms in a row. He chose to stop when he was 
convinced that he thoroughly understood the series. His next puzzle was 
also a REPEAT series with six terms in a period. He used "NEXT" twice 
to gather n,ore information and extended the series successfuUy for seven 
♦correct terms in a row. 

42 



38 



1. 


C. 1. W. B. \. 










2. 


NEXT 










3. 


C, 1. W. B. 1. X, 










4. 












5. 


NEXT 










6. 


1, W. B. 1. X, 


C, 








7. 


... 2 










8. 


C. 1, W. B, l/x. 


C, 


1, 






9. 


... w 










10. 


C, 1, W. B, 1. X. 


C. 


1. 


W, 




11. 


... B 










12. 


C, 1. W. B. 1. X. 


C. 


1. 


W, 


B. 


13. 












14. 


C, 1. W. B. I. X, 


C. 


1, 


W, 


B, 1, 


15. 


x_ 










IB. 


C, 1, W, B. 1, X, 


C, 


1, 


W, 


B. \, X, 


17. 


CHANGE 









(Puzzle 32. Difficulty 29] 



Figure 22. Seeking enough additional data in first hour. 



Summarizing the first hour's work, the student was seen to create 
and test reasonable hypotheses. However, in those cases when his hypothe- 
sis proved false, he was uhable to generate an alternate hypothesis. He 
used feedback from guesses to decide when to change puzzles. For most 
of the hour, three or four correct guesses or two incorrect guesses led to 
a change. During the last few minutes of the hour, wrong guesses led to 
gathering new data, a much more prodiictive strategy. The choice of new 
difficulty levels followed a simple rule: Increase dUficulty by one each 
time. This rule led to too slow an increase most of the time. 

Second Hour 

In his second hour of work, the student chose series of greater dUfi- 
culty than in his fi^st hour. The distribution of difficulty in the second hour 
is given in Table 2. 
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The student-, behavior on those seri.. which h. Cailed to .olve Calls 
into three categories: ,a) testin, hypotheses based on given data only; 
fb) accun^ulating additional data and testing hypotheses but failing to enter 
any correct .espon.e.. and (c) accu.nulati.g additional data and part.ally 
solving the series (some correct guesses). 

There were jus. .wo series in this hour's work on which the student 
had difficulty and did not use ■■NEXT." On one of these, the student tested 
only incorrect hypotheses before changing pu....les. as illustrated in Figure 
13. 71,e puz.le in Figure .3 is an Intersperse series comprised of two 
Skip subseries. 'H.is type of series was beyond the student-s level of con,- 
p.tence and was never solved during his Series experience. T^os. hypothe- 
ses tested in lines 2. 3. and 4 were atten^pts to extend the series by using 
differences between terms of the main ser.es. No awareness of the mter- 
.persed series is implied, and it is likely that the student used the only 
series-solving strategy in his cu. ren. repertoire to make those guesses. 
Additional data might therefore have been of no assistance in this particu- 
lar puzzle, conversely, had the student persisted by asking for new terms 

^hat he may have eventually recognized 
and testing hypotheses, it is possible that he may 

the intersperse relationship. 

another series in which additional information would n,ore likely have 
led to'a solution is illustrated in Figure 23. TU. pu.zle is an Intersperse 
series. Ti^e student's correct extension of .he second subseries in Une 
in^plies an awareness of the Intersperse pattern. His guess -O" (lino 4) 
reinforces the inference that he recognised two separate series and had 
only to deduce the precise Skip value in the first subseries. A request 
for more terms would have been a productive strategy here-, the student 
changed too soon. 
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1. H. U. K. V. N. 

2. ••• W 

3. H. U. K. V. N. W 

4. 0 

5. CHANGE 

(Puzzle 53, Difficulty 321 

V . J 

Figure 23. Changing puzzles too soon in second hour. 

Additional data was requested by the student in all other series with 
which he had difficulty during the second hour of work. On several of 
these series, he did succeed in making some correct guesses. One such 
series is shown in Figure 11. The puzzle in Figure II is a Skip series 
of period three with differences between terms of +14, -5, and +21. The 
student asked for another term immediately (line 2), and made one incor- 
rect guess before proceeding to extend the series with two correct terms. 
He considered all available data in order to enter these terms with the 
increments of 21 and 14 in proper sequence. He stopped working before 
entering a third term which would have confirmed a total solution of the 
series, but he may have considered the series solved. 

Another appropriate use of "NEXT" is shown in Figure 12. The stu- 
dent guessed "N" (line 2) hypothesizing the third subseries to be ALPHA 
beginning at "M. " Feedback indicated this hypothesis was incorrect, and 
the student requested another term. He then extended the other two sub- 
series correctly. Once again, he stopped working without entering a cor- 
rect third term, but he was probably convinced of his own iinderstanding 
of the series when he stopped. Four other series included requests for 
additional data when needed and demonstrated the student making some 
progress toward solution. 
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The. student exercised proven.- solvinu skills on several series during 
his second hour on which he had no success. One such series appears in 
Figure 24. This scries is one with an increasing increment, a type with 
which the student had much difficulty. In this instance, the student tested 
three hypotheses (lines 2. 3. and 4) and asked for more data when feedback 
indicated they were incorrect (line 5). He made two more incorrect guesses 
(lines 7 and 8) and used "NEXT" twice to gather more terms for considera- 
tion (lines 9 and 1 1 ). This new information was apparently of no help. The 
student used whatever series-solving and problem- solving strategies were 
available to him. and when he could still make no progress, he appropriately 
chose to go to a new puzzle. In four other series, the student made no 
progress toward solution but chose to stop working at appropriate times. 



1. 6. '8, 12. 20, 36, 

2. 44 

3. 48 

4. 38 

5. NEXT 

6. 6. 8. 12. 20. 36. 68. 

7. 80 

8. W 

9. NEXT 

10. 6. 8, 12. 20. 36, 68. 132. 

11. NEXT 

12. 6, 8, 12. 2Cf. 36, 68 132. 26^. 

13. CHANGE 



(Puzzle 54, Difficulty ^Oi 



Figure 24. Good problem sotv.ny m second hour. 
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During this second hour, tliu student solved many series without 
errors or with minor arithmetic errors. His behavior changed considera- 
bly from such series in his first hour. Instead of entering his usual 3 to 5 
correct terms, as in the first hour, the student entered from I to 28 cor- 
rect responses in a row. He typed 6 or more right in a row on more than 
half of these puzzles. These series were trivial for the student, e.g., 
ALPHA beginning at A: 28 right in a row; COUNT beginning at 38: 13 right 
in a row. Such large numbers of correct answers in a row are excessive, 
and this behavior cannot be considered productive problem solving. 

Third Hour 

During hia third hour on Series, only ten puzzles proved difficult for 
the student. He tested hypotheses and requested additional data on all ten 
of these series and succeeded in solving two of them. Of those he could not 
solve, he did succeed partially on three. Typical third hour behavior on 
one of these appears in Figure 10. The student tested two hypotheses 
which proved incorrect (lines 2 and 3) and requested another term (line 4). 
His next guess (line 6) correctly incremented the new term by 1, but his 
next two hypotheses were not correct (lines 8 and 9). He again asked for 
more information but still could not discern a solution and appropriately 
chose to stop. This pattern of testing hypotheses and asking for "NEXT" 
is an effective problem- solving tactic which the student used frequently 
during the third hour. See also his behavior when working on the series in 
Figure 18. ^ 

Figure 25 illustrates soine typical third hour behavior. When the 
student's hypothesis in line 5 proved incorrect, he asked for another term. 
This was an appropriate time for the request, but the student then stopped 
working on the series. Here the student changed too soon. He did not 
persevere on the task long enough to determine how much progress he 
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might have made toward a solution. T^ie student stopped too soon on four 
other series during this hour. In contrast, the student stopped at an appro- 
priate time on Puzzle 90: he tested four hypotheses, asking for more data 
after the first and third, and stopped -^ork only when every series- solving 
strategy in his repertoire at that time was used. 



1. 1. 10. 2. 20. 4. 



30 



40 



1, 1^1. 2, 20. ^Q. 
NEXT 

]. 10, 2. 20. 4. 40, 
CHANGE 



(Puzzle 70. Oifficuttv 201 



Figure 25. Changtng puzzles too soon in third hour. 

The two series the student solved with effective problem-solving 
strategies during his third hour appear in Figure 3 and Figure 4. Hiese 
both Illustrate student testing of hypotheses, use of feedback from incor- 
rect guesses, requests for more information when needed, consideration 
of all of the available data, and appropriate choice of stopping time when 
solution was confirmed. 

On those puzzles which the student solved without algorithmic diffi- 
culty, or with no error., behavior changed during the third hour's work. 
Excessive correct terms in a row were entered in the early part of the 
hour (between 7 and 25 right in a row)', but no more than 5 correct re- 
sponses in a row were entered in the remainder of the hour on this type of 
puzzle. . " 
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Fourth Hour 

In his fourth hour on Series, the student worked on only six puzzles 
which required application of problem-solving skills. One of these was 
solved and extended successfully with use of feedback from two incorrect 
hypotheses, as is shown in Figure 18. Figure 7 and Figure 14 illustrate 
two more examples of student testing of hypotheses and use of "NEXT" 
but without progress toward solution. Figure 9 contains the last example 
of student problem solving leading to successful extensi£>n of a series. The 
student tested hypotheses, chose to gather information after receiving feed- 
back regarding these hypotheses, used all available data in his eventual 
solution, and stopped working when a solution was assured by five right 
terms in a row. 

On the rest of the series of this hour's work, the student made either 
arithmetic, typographical, or no errors. On three such series, he entered 
excessive correct terms in a row (53, 21,. and 32 terms). Oh the remain- 
ing 13 puzzles, the student stopped working after solution was assured by 
no more than 7 correct answers in a row. 

A final, more global, perspective for viewing the student's problem* 
solving behavior is to consider his plan for attacking the entire set of availa- 
ble series. The student's use of his overall result on a puzzle for choosing 
the subsequent difficulty level is one aspect of this behavior. 

Series are available at difficulty levels from 1 to 50. During his first 
hour of work, the student approached the series methodically, requesting 
difficulty levels in increments of one from his last request. In this way, he 
requested series from difficulty 1 to 31 in his first hour. He did not solve 
six puzzles during this time but chose to proceed one difficulty level at a 
time regardless of the result on any puzzle. Although he was primarily suc- 
cessful with the puzzles seen, the lack of responsiveness to feedback re- 
garding result cannot be considered a constructive problem-solving strategy. 

45 



49 



At the beginning of his second hour, the s£Udent continued his clin.b 
fron. 32 to 35 but encountered dUficulty with each puzzle. As a result, he 
abandoned his technique of steady incren^entation at this point. He began 
choosing difficulty levels with no clear pattern, still without regard for 
results on previous puzzles. (The one exception occurred at the end of his 
second hour when he resun^ed steady incren^entation fron. level 12 but aban- 
doned it early in the third hour at level 20. ) Only 15 puzzles worked on 
after the student's first rise in dUficulty level fron, 1 to 35 were of difficulty 
30 or greater: 9 of these 15 were puz.les at levels 45 to 50. clearly beyond 
his average con^petency level in series solving. "Ae rennainder of puzzles 
seen in the last three hours- work were primarily below difficulty level 20 
and provided little opportunity for additional learning. It is likely that had 
the student spent more time working on puzzles between the extremes of 
less than 20 and greater than 45, he would have enjoyed more opportunities 
for solving possible series. Instead, he worked on puzzles which were 
trivial or too difficult. 

■Summary of Pr nhlem-Solving Skill Development 

Problem- solving behavior changed dramatically within the student's 
first hour of work. Initially when the student encountered difficult series, 
he neglected to request additional information, tested few hypotheses, d.d 
not consider all available data, and chose to stop work too soon. By the 
end of the hour, more productive strategies were evident, l^o student 
learned to use "NEXT" at times when more information was needed, tested 
hypotheses, and persevered until there was enough information to solve 
series. He stopped work when his understanding was apparent. However, 
the majority of series worked on in the first hour were too easy for the 
student. 

Although the student's behavior in the first hour indicated that pro- 
: ductive problem-solving skills were available, his subsequent behavior 
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deteriorated in some respects. Throughout the rest of his history, "NEXT" 
was used effectively to gather needed additional information. However, the 
student stopped work too soon on numerous occasions or, conversely, per- 
sisted in entering correct responses on trivial puzzles. Difficulty levels 
chosen were, for the most part, either too low or too high. Therefore, the 
student's exposure to solvable middle-range problems was limited. It 
would have been in this middle range that problem-solving skills might have 
been most effectively applied and practiced. 

Conclusions 

A detailed study of one student, such as this, leaves open questions 
about the generality of findings. While these can only be answered by 
studies of more students, it is possible to supplement these findings with 
informal impressions from other data. In all, over 250 students have used 
the program for as little as 10 minutes or as long as 10 hours. One large 
group of students has had only one session, a controlled introduction to the 
program. Of those who have worked a second time, the average time at 
work is nearly one hour. The authors have looked at all the protocols of 
all the students; their impressions are qualitative. 

Few students begin their work with as many skills as this subject. 
Most have difficulty with Skip series with differences larger than 9, with 
an Intersperse series of low contrast terms, and with concatenation of any- 
thing but Basic series. Further, initial skills in problem solving--particu- 
larly the use of "NEXT" to gather information, the use of "CHANGE" when 
the puzzle is solved, and the selection of appropriate levels of difficulty- - 
are typically less developed than our student's skills. Most students im- 
prove in problem-solving and series- solving skills as they use the program, 
but only a few would surpass the performance of the student studied here. 
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Throughout the discussion, there have been references to inappropri- 
ate behavior by the student. One featurr of the Series program is that it 
allows students to exhibit inappropriate and unproductive behavior in a low- 
threat environment. Tl.c analysis. o( protocols gives the researchers in 
this case, or possibly a teacher, an opportunity to see precisely what 
problem-solving skills are present and which are absent. Few, U any, 
environments in the s 'l.ool rj'^rd this opportunity. 

Many of the inappropriate behaviors could be eliminated by modifica- 
tion to the series program: however, most of the obvious fixes remove the 
possibility of inappropriate behavior, and thus the chance to observe the 
problem-solving skills of the student. Consider some examples: 

The student did not reliably choose pu..^les at difficulty levels appro- 
priate to his skills. He spent most lime working on puzzles too hard or too 
easy for him. One proposed modification was tested by Heller (Note 1). 
She modified the program to choose a new puz-zlc close to the current level 
of work. The distance of the change was related to the result on the last 
puzzle and the students' estimate of how dUficult the pu-zzles were for them. 
No change ever exceeded three steps down or two stops up. This solution 
simply hides the problem. The students did progress appropriately in dU- 
ficulty. but they received no instruction and no experience selecting their 

l»vel of difficulty. No evaluation of their skills in that area i. possible. 
A second example concerns the use of "NEXT" by the student. A 
general heuristic in the Series program is that after one or, at most, two 
errors, the student should seek more information by typing "NEXT. " The 
student in this study grew in his ability to use "NEXT" appropriately; other 
students do not. A modification would force the use of "NEXT" after an 
incorrect guess; less drastically, the program could merely suggest the 
use of "NEXT. " In either case, the fact that the student uses "NEXT" when 
directed or forced to do so gives- no information about his general problem- 
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solving skills. It is only in the student-controlled environment as it stands 
that valid observation on this important skill is possible. 

Similar modifications could be suggested to make the student change 
; puzzles after some number of correct guesses, or after some fixed time 
without evident progress. These are open to the same criticism. 

A second kind of modification appears more promising; The program 
could explicitly reinforce the behaviors believed to be productive problem 
solving. Most are easily detectable, based on simple counts and occurrence 
of events. Reinforcement could be given on various schedules when good ' 
problem solving occurs. TTie present program relies on the intrinsic rein- 
forcement of "making progress" and the explicit reward of feedback on the 
entire puzzle. Perhaps more direct reinforcement would be more effective. 
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